
REPLY TO 
ATTN OF: 



Mission Planning and Analysis Division 
NATIONAL AERONAUTICS AND SPACE ADMINISTRATION 
LYNDON B. JOHNSON SPACE CENTER 
Houston, Texas 77058 


PM84 (74-143) 


May 20, 1974 


MEMORANDUM 

TO; Informal Distribution 

FROM: Fl^/Mathematical Physics Branch 

SUBJECT; Pattern Recognition Algorithm Using Temporal Data 

At the present time, classification is limited almost exclusively 
to the use of spectral information. This memorandum presents a 
method for classification using spectral and temporal information. 
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The value of a previously classified image may be seen by means of | 
the following example: Suppose two images are taken of a scene at \ 

different times, "then" and "now." Suppose no classification errors S 
were made in classifying the image "then." Further, suppose no j; 

change in class occurred for any pixel between "then” and "now." | 

Finally, suppose the images are registered perfectly; every element 
in each image is associated exactly with its appropriate counterpart.! 
In this case, the second image is already classified. Wo additional ; 
classification effort needs to be performed. Since these three error* 
sources are, in fact, always present, their effects should be modeled; 
to estimate appropriate a priori probabilities for the second image. !' 


Probability of a Signal X Belonging to Class 


For the discussion, assxune a signal X is to be classed into one of 
two classes, ^y, or The generalization to any number of classes S 

will be obvious. Suppose probability j'p 
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distributions of 'u and ^ respectively, evaluated at X, and that p cd 
W, and Wp are the numbers of elements in the image in yy. and yy , {2. 
respectively. Then, there exists W.,f (x) elements in yy with signal | w 
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The a priori probability of ir^ is 

W. 


O’. = 


1 + Ng 


Hence, 


h = “i * “a> 


or 


P(lTi |X) 


a^in^ + N2)fi(x) 

cy^(K^ + + a^(ii~+ N2)f2(x) 


< 

|x) 
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This is the probability that a signal belongs to class jr^ given that 
the value of the signal is X. 


Probability that a Pixel V Changed Class 


Suppose a pixel V in the first image was a vacant lot and was correctly 
classified "then." However, in the time interval between the two images, 
a house was built on pixel V. Clearly, the probability of this happen- 
ing must be considered in computing appropriate a priori probabilities 
for the second image. The probability of change of pixel from to p 
will be denoted by P(ir^«^ tt. )(V‘). Note, the probability of change 

:ids on IT . and n. as well as tl 
^ 3 


depends 


the location V. 


Assigning a value to the probability of change will require a model. 
Experience may be sufficient. For example, a county agricultural agent 
would have a knowledge of when harvest for a particular crop it. might 
occur, and would assign a high probability for P(7T^i»»^in )(v) at harvest 
time, where V was associated with the crop tr^, and if is the classifi- 
cation bare soil. 


Probability of Misregistration 

Denote by g(V,U) the probability of registering V in the old image with 
U in the new image. This means that in classifying pixel U in the new 
image, and attempting to use information from the old image response of 
pixel U, there is the probability g(V,U) that the information from pixel 
V will be used instead. Consequently, in calculating the a priori proba- 
bility of pixel U, the effect of the surrounding pixels, weighted by 
their respective probabilities, must be considered. 
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Putting Ib All Together 

Recall P( 7 T.|x) denotes the probahility of class given the signal X. 

Suppose a pixel V had a signal response of X "then." The prohahiliby 
that pixel V "now" belongs to class is 

E P(^ lx) • P(7T.-^1Ti)(V) 

j J * J 

Finally, since pixel U in the new image is not necessarily registered 
exactly bo its corresponding point in the old image, a weighted average 
of the above probabilities of V must be made, where the weight is the 
probability that U and V are registered. Hence, the probability that 
U in the new image is in class 77 ^ is 

P(U Tr.now) = 2 {g(v,u)[£ pCttJx) • P(7r.->7rJ (v) ]] 

® V 0 

notice, no assumption is made so far concerning the definition of 
f . (X) , PC-fT.-^tr- ) (V) , or g(V,U). The method is entirely general. In 

fact, defining will probably require knowledge of the 

J ^ 

specific application. However, some reasonable probability distri- 
butions may be suggested for f^(x) and g(V,U). For example, f^(X) 

may be assumed to be a discreti.ied transformation of a normal distri- 
bution, where the mean and covariance data are defined from training 
sets. The distribution function for registration g(V,U) may be 
assumed normal with expected value 0. The covariance matrix may be 
estimated using the registration residuals of known points. 

This algorithm will be coded in the near future, and will be tested 
using real and simulated data. 
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